Integrating Planning and Execution in Stochastic Domains
نویسندگان
چکیده
We investigate planning in time-critical domains represented as Markov Decision Processes. To reduce the computational cost of the algorithm we execute actions as we construct the plan, and sacrifice optimality by searching to a fixed depth and using a heuristic function to estimate the value of states. Although this paper concentrates on the search procedure, we also discuss ways of constructing heuristic functions that are suitable for this approach.
منابع مشابه
Realtime Concurrent Planning and Plan Execution in Stochastic Domains
In realtime planning domains, such as service robot control, an agent receives a task and must minimize the combined cost of planning and plan execution necessary to complete the task. To reduce the total cost, we examine the feasibility of performing planning continuously, while parts of the intermediate plan are being executed. The main challenges are to guarantee the completeness of the appr...
متن کاملIntegrating Planning and Temporal Reasoning for Domains with Durations and Time Windows
The treatment of exogenous events in planning is practically important in many domains. In this paper we focus on planning with exogenous events that happen at known times, and affect the plan actions by imposing that the execution of certain plan actions must be during some time windows. When actions have durations, handling such constraints adds an extra difficulty to planning, which we addre...
متن کاملStochastic differential equations and integrating factor
The aim of this paper is the analytical solutions the family of rst-order nonlinear stochastic differentialequations. We dene an integrating factor for the large class of special nonlinear stochasticdierential equations. With multiply both sides with the integrating factor, we introduce a deterministicdierential equation. The results showed the accuracy of the present work.
متن کاملOn representing planning domains under uncertainty
Planning is an important activity in military coalitions and the support of an automated planning tool could help military planners by reducing the cognitive burden of their work. Current AI planning paradigms use two different types of formalism to represent the planning problem. Each of these formalisms entails different inference algorithms and representation of results. On the one hand plan...
متن کاملIntegrating Planning and Execution for Information Gathering
Current specialized planners for query processing are designed to work in local, reliable, and predictable environments. However, there are a number of problems that arise in gathering information from large networks of distributed information. In this environment actions can be executed in parallel to exploit distributed resources, new goals come into the system in the midst of execution, acti...
متن کامل